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Fig. 3a 
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Fig. 5 



504 




Find common points or lines in 
overlapping parts of the images 
as seen by the n cameras. 



Manually registering, through input 
of parameters, such points or lines 



v Set-up process completed. Start 
^ registering of digital video 



sequence 



Compose the wide image from the 
individual images recorded 



Fig. 6 a 
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Fig. 6 b 
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Fig. 6e 
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Fig. 8 



Set up the cameras, preferably more than two, 
to cover approximately even areas giving an 
angle view of approximately 120 -160 
degrees. 



T 



Chose a reference camera. 



Identify manually a predetermined number of 
common points in an overlap region of a picture 
from the reference camera and the n* camera. 



Calculate X\ and Y n , where n is the n* camera, using 

„ . „ aX + bY + c , __. gX + hY + i 

formulas: X'= and F=— 

dX + eY + f dX + eY + f 



Repeat for all cameras up to the "n " camera. Form a 
matrix for the corresponding X* n and Y n and X and Y to be 
used in reproducing the further frames of the sequence 



▼ 

Determine the integers X*,Y* corresponding to X\ and Y n . 
Add to the matrix. Use the integers for calculating a 
weighted picture value to be applied to corresponding X,Y 
in the wide picture. 



Apply separate transformations to the X and Y 
coordinates, providing X+ and Y+ in order to transform 
the final picture such that straight lines appear as straight 
as possible. 
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FIG. 9 



Start of calibration process 



Synchronize the sequences 
from each camera 



If the sequence is sent live the there is 
no need for manual synchronization 



Find the lens distortion parameter(s) 

for each camera. Correct radial 
distortion in each image (if necessary) 



Compute inter-image projective 
transformations 



Use the transformations to refer each 
image to a common reference frame 



Choose a real or virtual reference camera 
such that certain lines on the pitch and/or 
stadium are essentially horizontal and 
parallel in the wide image 





Select non-linear distortion 
parameters to reduce perspective 
distortion of the wide image, if 
necessary 




1 


[ 




Select a rectangular region of 
interest within the wide image. 

This region contains the entire 

pitch and as much of the 
stadium as is required or visible 






r 


Record all computed values resulting 
from the calibration process to be used as 
the calibration parameters 



WO 2005/006776 



8/10 



PCT/SE2004/001110 



FIG. 10 

Apply the computed and registered calibration 
parameters 

For each pixel in the panoramic image, compute and 
store parameters describing 

• Which pixels from which image(s) contribute to 
this pixel in the panoramic image 

• How much these pixels each contribute to the 
panoramic image 




Obtain one new image from each camera, 
either from a live source or a memory 



If required, update the parameters needed to 
transform intensities (colours/brightness) in one 
or more cameras to eliminate visible seams 



If necessary, adjust the intensities 
(colours/brightness) in the images 
from one or more cameras. 

i 

Create the current seamless, wide image 
from the current images from each camera 



Output the wide image to a display or to 
a (possibly compressed) storage 



End of sequence 
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Fig. 12a 
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